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Description 

[0001] This invention relates to a method of antialias- 
ing edges of translated objects, utilizing gray masking 
techniques. This method can be employed to combine 
foreground and background images. 
[0002] Some printers and displays are capable of re- 
producing multiple levels of grey, as compared to the 
common printers that print only black or non-black. Such 
grey level printers include those using dye diffusion, di- 
rect electrostatic printing, certain grey printing ink jet de- 
vices, and hyperacuity printers. Additionally, printers 
that take in continuous tone input, even if those printers 
then halftone the input, are considered continuous tone, 
particularly if the halftoning occurs at a resolution higher 
than the image input resolution. Such printers operate 
to directly reproduce continuous tone images, as com- 
pared, for example, to binary printers that operate to 
print black and white, and require halftoned input to pro- 
duce images that appear grey when viewed at normal 
distances. Grey printers may also be capable of repro- 
ducing continuous tone polychromatic images, when 
provided with the appropriate marking materials, and ar- 
rangements that allow the superposition of different 
marking material separations." Here, we refer to grey 
printers as the class of printers that print more than 
about 2 levels of grey, and preferably in the range from 
16 to 256 levels of grey. 

[0003] The process of constructing a raster image 
takes as input a series of input primitives (such as char- 
acters, polygons, and scanned images) which are 
drawn sequentially onto an existing background image 
(which conceptually, at least, may be considered to be 
an array of pixels or image signals, each of which con- 
tains the current background color). The background im- 
age begins blank, and when all of the input primitives in 
the series have been drawn, it contains the desired 
raster image. The raster image may then be displayed 
or transmitted to a raster output printer. The input prim- 
itives each have associated with them a color and a 
shape. One way of describing the primitives is to con- 
sider the shape to be a mask or stencil, and the color as 
an ink which is put through the mask. The mask is com- 
monly represented digitally, with a zero value represent- 
ing opaque (impermeable) and a one value representing 
transparent (permeable). As an input primitive (the fore- 
ground image) is combined with the background image, 
for each pixel in which the mask value is 1 , the corre- 
sponding pixel in the background image has its value 
replaced with that of the ink (the foreground color). 
[0004] In almost any digital printing method, the 
shapes of graphical objects and text are dictated by bi- 
nary masks. Each pixel forming an object is either a part 
of the object, or it is not. Thus, representations of edges 
that are not exactly aligned with fast scan or slow scan 
processing directions of a printing device are character- 
ized by sharp, jagged or sawtoothed edges (aliased 
edges) reflecting the attempt to approximate the edge 



on pixel boundaries, as illustrated in Figure 1. See, for 
example Foley et al, Computer Graphics Principles and 
Practice, pp. 72-91 (1990), which discusses how such 
lines are created. One desirable aspect of this construc- 

5 tion is that it enables edges to butt together when two 
objects are placed side-by-side, enabling the formation 
of complex images. However, when exposed, aliased 
edges are often deemed unattractive, and detracting 
from image quality. Aliasing, therefore, refers to the in- 
fo traduction of low frequency components of the (sam- 
pled) image that would not be present in an ideal (not 
sampled) image, but which occur in the actual image as 
an artifact of the sampling rate. Frequencies above half 
the sampling rate in the ideal image appear 'aliased' as 

15 frequencies below the sampling rate. 

[0005] One approach to resolving this problem is to 
increase resolution so that the jagged edges become 
finer and are better integrated by the eye. However, in- 
creasing resolution is costly in any reproduction device. 

20 [0006] Another well known process in the graphics 
arts community for alleviating the aliasing problems on 
CRT displays is referred to as "antialiasing". Antialiasing 
techniques attempt to remove higher frequencies ap- 
pearing in the image or to limit them to cases that are 

25 likely to match the ideal image. This process entails 
placing grey pixels at object edges to soften the transi- 
tion between foreground and background, as illustrated 
in Figure 2. Typically each edge pixel is given a grey 
value that is a weighted average of the foreground and 

30 background levels, with the weights depending on the 
location of the edge of the idealized object passing 
through it. See, for example, "The Aliasing Problem in 
Computer-Generated Shaded Images", Comm. ACM, 
Vol. 20, No. 11, Nov. 1977, by F. Crow, pp. 799-805; "A 

35 New Simple and Efficient Antialiasing with Subpixel 
Masks", Computer Graphics, Vol. 25, No. 4, July 1991 , 
by A. Schilling; also, WO-A-91/14995 A1. Also note 
US-A 5,333,249. 

[0007] Applying antialiasing to the ink/mask model, 

40 the mask is no longer binary: values between 0 and 1 
are used along the edges to represent partial coverage 
of a pixel by the mask. Typically, as a new primitive is 
drawn into the background image, a weighted average 
of the ink with the background value is used as the new 

45 background value. Specifically, the value of the mask is 
multiplied by the ink value, while one minus the value of 
the mask is multiplied by the background value, and the 
two are summed to give the new background value. For 
example, in the interior of an object, the mask value is 

50 1 , and so the ink color is used on its own, while in the 
exterior, the value is 0, so the background remains un- 
changed. For a pixel on the edge, if the mask half covers 
the pixel, the pixel and background will be equally 
weighted. This approach is known in the art as alpha- 

55 blending, ( where alpha is the opacity or mask value). 
See, for example, WO-A-91/14995 and "Compositing 
Digital Images", Porter et al., SIGGRRAPH '84, Compu- 
ter Graphics, Vol. 18, No. 3, July 1984; pp. 253-259. 
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[0008] The technique can also be applied to text to 
improve its quality, as illustrated in Figures 3A and 3B. 
However, antialiased characters can only be positioned 
on the display device grid. For a typical CRT this would 
mean that character placement is quantized to 1/72". 5 
This results in characters appearing unevenly spaced 
(some character pairs too close and some too far apart 
in words). It is possible to construct an antialiased in- 
stance of a character at any position (i.e., a much finer 
spacing than the display grid), but this requires a distinct 
version of the character for every position. It would mean 
storing a copy for each desired position, which may re- 
quire too much memory, especially if fine positioning is 
needed. Alternatively, one could use commonly known 
techniques of raster translation, but this results in un- 
necessarily blurring. the character. 
[0009] As used herein, translate and translation refer 
to spatial positioning or movement. 
[0010] The present invention is directed to a method 
of translating or transforming antialiased masks. The in- 
vention provides methods in accordance with claims 1 , 
3 and 4 of the appended claims. 
[001 1] In accordance with one aspect of the present 
invention as claimed in claim 4, there is provided an im- 
proved method for translating antialiased edges ex- 
pressed by an object mask, using high resolution edge 
information derived from low resolution grey image rep- 
resentations. By treating the object edge pixels in a high 
resolution grey model, characteristics of the edge rep- 
resented by an edge pixel can be approximated by ref- 
erence to surrounding grey elements. Edge movement 
can be approximated by changing the mask values in 
the high resolution grey model. Changes in the overall 
grey level of the pixel resulting from the mask changes 
cause the impression of edge movement in the low res- 
olution edge. 

[0012] In accordance with another aspect of the in- 
vention as claimed in claim 1 , there is provided an im- 
proved method for combining an existing image A, and 
a grey mask M for a character to be added to image A, 
and a shade value and location for the character, includ- 
ing the steps of: 1) expanding gray mask M to a bitmap 
m; 2) translating or moving m with respect to image A 
by some number of subpixels; 3) finding pixels in image 
A overlapped by the translation of m; 4) expanding those 
pixels found in A to a bitmap B; 5) replacing any subpix- 
els of the expanded pixels corresponding to a pixel in m 
with the current shade value, and 6) filtering those pixels 
in B and returning the filtered pixels to A. Grey mask M 
can be expanded into bitmap m all at once or as each 
pixel is needed. 

[0013] As an alternative to the method as claimed in 
claim 1 , the method claimed in claim 3 may take the form 
of: 1) expanding gray mask M to a bitmap m; 2) trans- 
lating or moving m with respect to image A by some 
number of subpixels; 3) averaging the gray mask to yield 
a new antialiased mask at the translated location; 4) 
finding pixels in image A overlapped by the translation 



of m; 5) alpha blending the expanded value set to de- 
termine the new antialiased mask. 
[0014] In accordance with an embodiment of the in- 
vention as claimed in claim 7, there is provided a method 
of processing an antialiased mask, for improved edge 
rendition, the method comprising: a) receiving mask val- 
ues with an antialiased edge, for a pixel of interest and 
a plurality of neighboring pixels thereto in the mask; b) 
subdividing the pixel of interest into a predetermined 
number of subpixels; c) determining from the mask data 
for the pixel of interest a number p of subpixels that 
should be permeable; d) determining a permeability val- 
ue for each subpixel as a function of the mask value of 
the pixel of interest, the mask value of at least one neigh- 
bor and the relative position of the subpixel in the pixel 
of interest and the at least one neighbor; e) sorting the 
determined permeability values by magnitude, and 
identifying subpixels having the p largest magnitudes as 
permeable; f) realigning the mask defining the object 
boundaries among the subpixels forming the pixel of in- 
terest; and g) averaging the mask values of all the sub- 
pixels to obtain the antialiased value of the pixel. 
[0015] This invention provides a solution to the prob- 
lem of antialiased edges. The gradations of grey at edg- 
es change the apparent position of the edge at normal 
viewing conditions. By carefully selecting the grey level 
of the pixels at an edge, the apparent position of the 
edge is made to move. The present invention therefore 
provides a way to shift or translate an antialiased edge 
by subpixel amounts, without blurring it further than is 
already done for antialiasing. For character processing, 
a single instance of each character can be stored and 
shifted as needed for finer positioning. 
[0016] A more complete understanding of the present 
invention can be obtained by considering the following 
detailed description in conjunction with the accompany- 
ing drawings in which: 

Figure 1 illustrates the problem of aliasing or jag- 
gies; 

Figure 2 illustrates antialiasing using grey pixels at 
object boundaries; 

Figures 3A and 3B illustrate the appearance of a 
foreground object edge to be combined with a back- 
ground; 

Figures 4, 5, and 6 together illustrate the principle 
of using surrounding pixel information to derive the 
mask value for each pixel; 

Figures 7A, 7B, and 7C together illustrate the sub- 
pixel positioning of edges in accordance with the in- 
vention; 

Figure 8 represents an exemplary system in which 
the present invention may find use; 
Figures 9 and 10 illustrate a flow chart of the inven- 
tive process; and 

Figure 11 illustrates the subpixel replacement proc- 
ess. 
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[001 7] With reference now to the drawings, where the 
showings are for the purpose of illustrating an embodi- 
ment of the invention and not for limiting same, Figures 
4-7 illustrate the principle of the present invention. In ac- 
cordance with the present invention, estimates of the re- 5 
gions of the pixel covered by the new object and each 
of the background shades are combined to give a cur- 
rent value of each pixel. This is done by taking the cur- 
rent pixel and its eight immediate neighbors as a model 
for the behavior of the image within the pixel. Figure 4 10 
illustrates pixel X and its immediate neighbors A-H. 
While the present invention is described with references 
to immediate neighbors, extensions of the invention 
might use an increased or decreased number of neigh- 
bors. A "pixel" refers to an image signal associated with 1$ 
a particular position in an image, having a shade be- 
tween white and black. Accordingly, pixels are defined 
by intensity (or density) and position. "Grey", as used 
herein does not refer to a color unless specifically iden- 
tified as such. Rather, the term refers to image signals 20 
that vary between maximum and minimum, irrespective 
of the color of any separation in which the image signals 
are used. As used herein, images are ordered collec- 
tions of image signals acquired by scanning an original 
document with a document scanner, an electronic cam- 25 
era or the like; or by a computer operated in accordance 
with a computer graphics generation program; or ob- 
tained from a memory without reference to the original 
source. 

[0018] As used herein, "foreground" refers to the new 30 
object being added to an image during the construction 
of a final image. "Background" refers to the existing im- 
age's state at the point before a new foreground object 
is added. The background may include objects added 
to the image prior to the current object of interest. As 35 
the term will be used herein, "shade" refers to the color / 
or intensity of objects such as the foreground object of 
interest, on objects in the background. As used herein, 
"mask" refers to a description of an object's shape. To 
describe an object one must indicate both its shape and *o 
its color (i.e., its mask and shade). One can think of the 
process of adding an object to an image as painting ink 
through a stencil onto a background image. The stencil 
provides the shape and acts as the mask. The ink pro- 
vides the shade. The shape defining stencil has areas 45 
that are open and permit the ink to pass, and other areas 
where the flow of ink is blocked. In accordance with this 
analogy, regions where the foreground shade is permit- 
ted to replace the background are referred to as perme- 
able. Areas where the background remains correspond 50 
to regions of the mask that are not permeable. 
[0019] Image information received may be in a 
number of formats. In the class of images received via 
a PDL description, the images are described in resolu- 
tion independent terms and accordingly can be decom- 55 
posed into an image element of any arbitrary or useful 
resolution. Images may be received already prepared 
for rendering at a given printer, at the printer resolution. 
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Image elements to be combined may also be received 
at multiple resolutions, requiring conversion as required 
to a common resolution. 

[0020] Considering initially a PDL-described image, 
as it is initially decomposed into a bitmap, a foreground 
object will have a shade value i and mask value M at 
each pixel forming the object, in order to blend shade 
and background. A mask value represents how much of 
a pixel is covered by the object. It should be clear that 
in some locations in the image, no blending occurs, and 
the value of the pixel is either the object shade, or the 
background shade. At other locations however, the 
mask value represents the partial covering of the pixels 
by the object or the background. The problem is to es- 
timate the shape of the object within the pixel bounda- 
ries from the mask value of the pixel and the mask val- 
ues of the neighboring pixels. The shape of the object 
within the pixel is defined in terms of an increased or 
hyper-resolution grid of regions or subpixels within the 
pixel. 

[0021] With reference now to Figure 5, pixel X is di- 
vided into S subregions or subpixels. In one embodi- 
ment, shown in our example, S=25 has been selected 
as a convenient number of subpixels for calculation pur- 
poses, with smaller or larger numbers, greater than 1, 
not precluded. A smaller number of subpixels may not 
accurately characterize changes in the mask over the 
pixel area, while a larger number will increase process- 
ing time. The subpixels have also been illustrated for 
convenience as corresponding to equal sized regions. 
This is not necessarily the case. 
[0022] To be determined are which subpixels should 
be permeable and which should be opaque. Under the 
assumption that a sharp edge is being represented by 
the mask, subpixels are either made totally opaque or 
totally permeable. The fraction of the subpixels that are 
permeable should match the value M of the mask of this 
pixel. Stated another way, in an 8 bit system, where the 
number of possible display or printing levels N is equal 
to 256 (including 0), if mask value M is given as 

0 < M < 255 

and the number of subpixels is S then the number p of 
permeable subpixels would be given as 



[0023] A fractional permeability parameter P of each 
subpixel is determined by interpolating mask values of 
neighboring pixels (for example using linear interpola- 
tion), which for the example pixel and its neighbors 
shown in Figures 4 and 5, are given in Figure 6. Then, 
the p subpixels with the highest fractional permeability 
values P are selected. It will be appreciated that what is 
important is that subpixel mask values be derived that 
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reflect relative relationships of the mask values of pixel 
X and pixels neighboring pixel X. There are many po- 
tential functions that describe such relationships and 
could be substituted for the linear interpolation function 
described and illustrated here. 
[0024] ' Looking to the array of Figure 6, the most per- 
meable subpixels are available by the logical function of 
sorting. Sorting techniques are well known and many 
methods can be used; the heapsort technique (See, e. 
g., Knuth, "Sorting and Searching," The Art of Computer 
Programming, Vol. 3, pp. 145-149, Addison-Wesley 
Publishing Co., 1973.) is, however, particularly well suit- 
ed because it computes each next largest value as 
needed. This means it minimizes the required compu- 
tation when only a partial sorted list is required. In this 
case only the p largest values (or S-p smallest values) 
are needed, and sorting computation can cease once 
they have been identified. The function heapsort can 
sort the subpixels and select those subpixels with the 
largest permeability values. One need not perform a full 
sorting of all subpixels, but at most half of them, since 
either p or S-p regions will do (at most 12 for the 5 x 5 
case). If p is greater than half the subpixels, one can use 
of the heapsort function to discover the (S-p) smaller 
values regions, and then determine the complement to 
get the largest valued regions. This means that the sort 
can always be terminated less than halfway through the 
list of entries. 

[0025] With reference now to Figure 7A, the pixel X 
can be modeled as having only two shades, shown as 
X', with the mask value being either permeable or 
opaque, and with each subpixel having a value indicat- 
ing such a condition, the equivalent of a binary system. 
At Figure 7B, the mask can be moved, by increments of 
the selected subpixel resolution. Once the high resolu- 
tion binary mask has been derived for the pixel and its 
neighbors (here denoted as D and E), the mask can be 
realigned with the display grid according to the desired 
translation, thus deriving new pixel X". Accordingly, at 
Figure 7C t the middle pixel X" now represents a new 
edge between the two distinctly colored pixels. Of 
course, the mask values can be moved in any direction 
or combination of directions. 

[0026] With the realigned subpixel mask values de- 
termined, the final step is to average the values for all 
of the subpixels of the pixel. The resulting average value 
is the new mask value for the pixel of interest. 
[0027] The above analysis is rather complex to be car- 
ried out efficiently on a per pixel basis. Fortunately, the 
most common cases do not require this degree of 
processing. Often one can calculate and cache the shift- 
ed mask for the translated object (e.g., a character 
mask). One can determine the subpixel mask for the ob- 
ject, translate that mask and reduce it to an antialiased 
normal resolution mask for combination with the back- 
ground. For objects such as characters this processing 
can be done once and the translated mask saved for 
use in multiple instances of the characters placement in 



the image. If the mask value after translation is 0 (a min- 
imum value in an 8 bit system indicating impermeability), 
then the pixel shade is set to the background value X b , 
that is, the pixel value is unchanged. If the mask value 

5 after translation is 255 (a maximum value in an 8 bit sys- 
tem indicating permeability) then the result is set to the 
foreground object shade i. If the background value is 
white or black (255 or 0) or if the maximum value match- 
es the minimum value (MX=MN), then the background 

10 is considered uniform and the alpha blending formula, 
given as 

( X M* + (N-X M )Xb)/ N 

15 

can be used as the resulting pixel value. 
[0028] If the background values are not uniform, then 
a method to combine background and foreground can 
be used. This method may also employ the construction 

20 of a high resolution model for the mask as well as a mod- 
el for the background, and computation can be made 
more efficient by using the high resolution mask con- 
structed by the method described herein for object 
translation, as the mask employed when the object is 

25 integrated with the background. 

[0029] Referring now to Figure 8, a basic document 
processing system is shown including a document 
processing system 102. The image processing system 
112 receives image information either through input de- 

30 vice interface 103 or network interface 104. In this em- 
bodiment, input device interface 103 is connected to 
scanner 105 which generates images l(x,y,d) having a 
defined width x, length y and number of density levels 
d. Common scanners, such, for example, the Pixelcraft 

35 7650, produce 8 bit/pixel data, providing d=256, at res- 
olutions acceptable for many purposes. Color images 
may be defined by a plurality of bitmaps. Alternatively, 
image information received through network interface 

104 from network 106 can be transmitted from devices 
40 such as remote scanners, file servers or page descrip- 
tion language (PDL) drivers (not shown). Information re- 
ceived through network interface 104 may contain in 
part or in full image information in the form of raster im- 
ages having a defined width, length and depth. 

45 [0030] Once a raster image is received from scanner 

105 by document processing system 102, image i(x,y, 
d) is transmitted to image memory 107 either through 
connection 108 or data bus 109 as directed by system 
controller 111. In the event image information is simul- 

50 taneously received through interfaces 103 and 104, 
controller 111 routes image information from network 6 
to secondary storage or hard disk 113 through data bus 
1 09 and image information from input device or scanner 
1 05 to primary storage or image memory 1 07 using con- 

55 nection 108. Once image information such as image I 
(x,y,d) is received and stored in memory 107, image 
processor 112 is invoked by controller 111 as pro- 
grammed through user interface 110 which operates on 
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a video display or the like. Subsequent to processing 
image l(x,y,d) resulting in antialiased image information, 
the image stored in memory 107 is either reproduced 
on output device or printer 119 through connection 114 
and output device interface 118 or transmitted to sec- 5 
ondary storage 1 1 3 or a remote device connected to net- 
work 106 through data bus 109. It will be noted that the 
present invention applies primarily to the case of the 
combination of images, e.g., when shapes defined by a 
PDL file overprint a scanned image. 
[0031] Now, the invention will, be described in terms 
of a set of steps. With reference now to Figure 9, initially, 
image signals representing mask values are obtained 
for a pixel of interest (X) and its adjacent neighbors A-H 
at step 202. At step 204, a set of S subpixels (in the 
described embodiment S=25 subpixels) corresponding 
to pixel X is identified. Based on the number of subpixels 
identified and the mask value of X, at step 206, a number 
p is derived, representing the number of subpixels that 
should be (totally) permeable in pixel X. At step 208, a 
fractional permeability value P for each subpixel is cal- 
culated, as a function of the position of the subpixel in 
the array of S values, the mask values for the neighbor- 
ing pixels A-H, and the mask value of pixel X. Step 210 
suggests that this function is preferably a linear interpo- 
lation process, which returns the values described at 
Figure 6. Other functions that derive relative values of 
each subpixel based on surrounding pixels can be used. 
[0032] At step 212, the subpixels are sorted by frac- 
tional permeability value P, so that at step 214, the sub- 
pixels with the largest fractional permeability values P 
can be identified. At step 216, if the subpixel is in the set 
of subpixels having the largest fractional permeability 
values P, then a flag is set for the subpixel indicating that 
it is "permeable". Otherwise the flag indicates that the 
subpixel is not permeable (step 220). 
[0033] At this point, the foreground mask is available 
at high resolution. By collecting pixels expanded in this 
way, the high resolution mask can be found for any re- 
gion of the object or for the entire object, The high res- 
olution mask is then translated to the desired position 
with subpixel accuracy. 

[0034] During the remainder of the process, the infor- 
mation about the subpixels, which is derived from what 
might be occurring at neighboring pixels, is used to de- 
termine shade and mask values for pixel X. With refer- 
ence to Figure 10, at step 320, the flag for each subpixel 
is reviewed to see if it is permeable. At step 322, if the 
flag is set to indicate permeability, the subpixel shade is 
set to the object shade. Otherwise, at step 324, the sub- 
pixel is set to either of the background shades, depend- 
ing on whether it was assigned value MN or MX. 
[0035] At step 326, the subpixel mask bitmap is trans- 
lated by an integral subpixel amount. With reference to 
Figure 1 1 , as subpixels are translated away from the pix- 
el boundary, subpixels from neighboring pixels are used 
to fill the gap. Processing does not take place on each 
pixel independently, but rather one must determine the 



subpixel expansions of masks for a several pixel neigh- 
borhood so that the realignment can cross pixel bound- 
aries. The pixel for which the mask is expanded is dif- 
ferent from the pixel for which the background is ex- 
panded. Reference is made to Figure 11, which shows 
that as a mask pixel is translated, an area may be un- 
covered or no longer occupied, that then requires filling, 
perhaps with background. If pixel expansions are saved, 
it is a small matter to use such values to fill the uncov- 
ered area. 

[0036] Returning to Figure 10, at step 330, the sub- 
pixel mask value is averaged together. At step 332, the 
pixel mask is set to the average mask value determined 
at step 330. The process then begins again for the next 
pixel. 

[0037] The gradations of grey at character edges 
change the apparent position of the edge at normal 
viewing conditions. By carefully selecting the grey level 
of the pixel at an edge, the apparent position of the edge 
is made to move. 

[0038] The disclosed method may be readily imple- 
mented in software using object oriented software de- 
velopment environments that provide portable source 
code that can be used on a variety of computer or work- 
station hardware platforms. Alternatively, the disclosed 
image processing system may be implemented partially 
or fully in hardware using standard logic circuits or spe- 
cifically on a single chip using VLSI design. Whether 
software or hardware is used to implement the system 
varies depending on the speed and efficiency require- 
ments of the system and also the particular function and 
the particular software or hardware systems and the 
particular microprocessor or microcomputer systems 
being utilized. The image processing system, however, 
can be readily developed by those skilled in the appli- 
cable arts without undue experimentation from the func- v 
tional description provided herein together with a gen- 
eral knowledge of the computer arts. 



Claims 

1. A method for making changes in object edge posi- 
tion in continuous tone images combining an exist- 
ing image A, a grey mask M and a shade value C 
for an object to be added to image A, including the 
steps of: 

1) providing a gray mask M including pixels 
having continuous tone values employing a 
number of gray levels G greater than 2; 
characterised by: 

2) expanding gray mask M to a bitmap m de- 
fined in terms of subpixels; 

3) translating or moving m with respect to image 
A some number of subpixels to yield a translat- 
ed subpixel mask m'; 

4) finding pixels in A overlapped by m'; 



15 



20 



25 



30 



35 



40 



45 



50 



6 



11 



EP 0 814 431 B1 



12 



5) expanding those pixels found in A to a bitmap 
of subpixeis B; 

6) replacing any subpixeis of the expanded pix- 
els corresponding to ink in m' with the shade 
value C; and 5 

7) filtering those pixels in B and returning the 
filtered pixels to A. 

2. The method of claim 1 where the expanding in step 
5 includes: io 

a) determining for the pixel of interest and the 
plurality of neighboring pixels a minimum shade 
value and a maximum shade value; 

b) determining a shade value for each subpixel * 5 
as a function of the shade value of the pixel of 
interest, the shade value of at least one neigh- 
bor and the relative position of the subpixel in 

the pixel of interest and the at least one neigh- 
bor; 20 

c) sorting the determined shade values by mag- 
nitude, assigning the maximum shade value to 
subpixeis having the q largest shade values 
and assigning the minimum shade value to the 
remaining subpixeis.* 25 



number of gray levels G greater than 2; 

2) providing a high resolution version of the pix- 
els of interest in the object mask, including a 
plurality of subpixeis; 

characterised by: 

3) assigning a binary mask value m to each 
subpixel as a function of a position thereof with- 
in the pixel of interest and the values of any pix- 
els neighboring the pixel of interest; 

4) varying the subpixel mask values to translate 
the edge position within an pixel of interest; 

5) combining said varied high resolution ver- 
sions of pixels in the scope of the desired trans- 
lation about an pixel of interest by averaging the 
subpixel mask values in the pixel of interest to 
determine a final output mask value forthe pixel 
of interest. 

5. The method of claim 4 where step 2 includes receiv- 
ing a plurality of neighboring pixels for each of the 
pixels of interest. 

6. The method of any of the preceding claims where 
the plurality of subpixeis for each pixel is a prede- 
termined number N. 



3. A method for making changes in object edge posi- 
tion in continuous tone images combining an exist- 
ing image A, a grey mask M and a color C for an 
object to be added to image A, including the steps 30 
of: 

1) providing a gray mask M including pixels 
having continous tone values employing a 
number of gray levels G greater than 2; 35 

2) expanding gray mask M to a bitmap m de- 
fined in terms of subpixeis; 
characterised by: 

3) translating or moving m with respect to image 

A by some number of subpixeis to obtain a *o 
translated bitmap m' ; 

4) averaging the values of bitmap m' to yield a 
new antialiased mask M* at the translated loca- 
tion; 

5) finding pixels in image A overlapped by M'; 45 

6) alpha blending for those pixels the current 
color C with the existing image A using the new 
mask M' as an alpha factor to determine the 
new image. 

50 

4. A method of translating antialiased edges ex- 
pressed by an object mask, by using high resolution 
edge information derived from low resolution image 
representations, said edges including pixels and 
the method including: 55 

1) providing an object mask including pixels 
having continuous tone values employing a 



7. The method of claim 1 to 3 wherein step 2, or of 
claims 4 to 6 wherein step 3 includes: 

1 ) determining from the mask value forthe pixel 
of interest a number p of subpixeis that should 
be transparent; 

2) determining a fractional permeability value 
for each subpixel as a function of the mask val- 
ue of the pixel of interest, the mask value of at 
least one neighboring pixel in the plurality 
thereof and the relative position of the subpixel 
in the pixel of interest from the at least one 
neighbor; 

3) sorting the determined fractional permeabil- 
ity values by magnitudes, and identifying those 
subpixeis having the p largest magnitudes as 
permeable. 

8. The method as defined in any of the preceding 
claims, wherein the plurality of neighbors includes 
8 adjacent pixels, and the predetermined number 
of subpixeis is about 25. 

9. The method as defined in any of the preceding 
claims, wherein p is determined by the function: 



where M is the mask value of the pixel of interest, 
S is the number of subpixeis and N is the mask val- 
ue of a fully permeable pixel. 
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Patentanspruche 

1 . Verfahren zum Vornehmen von Anderungen in ei- 
ner Objekt-Kanten-Position in Bildern mit kontinu- 
ierlichem Ton, wobei ein existierendes Bild A, eine 5 
Grau-Maske M und ein Schattierungs-Wert C fur ein 
Objekt, das zu Bild A hinzugefugt werden soil, kom- 
biniert werden, umfassend die Schritte: 

1) Vorsehen einer Grau-Maske M, umfassend 
Pixel, die Werte eines kontinuierlichen Tons ha- 
ben, einsetzend eine Anzahl von Grau-Pegeln 
G grolier als 2; 
gekennzeichnet durch: 

2) Expandieren einer Grau-Maske M zu einer 
Bitliste m, definiert in Termen von Unter-Pixeln; 

3) Translatieren oder Bewegen von m in Bezug 
auf Bild A eine bestimmte Anzahl von Unter- 
Pixeln, urn eine translatierte Unter-Pixel-Mas- 
ke m' zu erzielen; 

4) Finden von Pixeln in A uberlappt mit m'; 

5) Expandieren dieser Pixel, gefunden in A, zu 
einer Bitliste von Unter-Pixeln B; 

6) Ersetzen irgendwelcher Pixel der expandier- 
ten Pixel entsprechend einer Farbe in m' mit 
dem Schattierungs-Wert C; und 

7) Filtern dieser Pixel in B und Ruckfuhren der 
gefilterten Pixel zu A. 

2. Verfahren nach Anspruch 1, wobei das Expandie- 
ren im Schritt 5 umfasst: 

a) Bestimmen fur das Pixel, das von Interesse 
ist, und die Vielzahl von Nachbar-Pixeln einen 
minimalen Schattierungs-Wert und einen maxi- 
ma len Schattierungs-Wert; 

b) Bestimmen eines Schattierungs-Werts fur 
jedes Unter-Pixel als eine Funktion des Schat- 
tierungs-Werts des Pixels, das von Interesse 
ist, des Schattierungs-Werts mindestens eines 
Nachbarn und der relativen Position des Unter- 
Pixels in dem Pixel, das von Interesse ist, und 
des mindestens einen Nachbarn. 

c) Sortieren der bestimmten Schattierungs- 
Werte nach Grolie, Zuordnen des maximalen 
Schattierungs-Werts zu Unter-Pixeln, die die q 
grdflten Schattierungs-Werte haben, und Zu- 
ordnen des minimalen Schattierungs-Werts zu 
den verbleibenden Unter-Pixeln. 

3. Verfahren zum Vornehmen von Anderungen in ei- 
ner Objekt-Kanten-Position in Bildern mit kontinu- 
ierlichem Ton, wobei ein existierendes Bild A, eine 
Grau-Maske M und eine Farbe C fur ein Objekt, das 
zu Bild A hinzugefugt werden soil, kombiniert wer- 
den, umfassend die Schritte: 

1) Vorsehen einer Grau-Maske M, umfassend 



Pixel, die Werte eines kontinuierlichen Tons ha- 
ben, einsetzend eine Anzahl von Grau-Pegeln 
G grofter als 2; 

2) Expandieren einer Grau-Maske M zu einer 
Bitliste m, definiert in Termen von Unter-Pixeln; 
gekennzeichnet durch: 

3) Translatieren oder Bewegen von m in Bezug 
auf Bild A eine bestimmte Anzahl von Unter- 
Pixeln, urn eine translatierte Bitliste m' zu erhal- 
ten; 

4) Mitteln der Werte der Bitliste m\ urn eine 
neue, antialtasierte Maske M' an der translatier- 
ten Stelle zu erzielen; 

5) Finden von Pixeln im Bild A, uberlappt durch 
M'; 

6) Alpha-Mischen fur diese Pixel der momen- 
tanen Farbe C mit dem existierenden Bild A un- 
terVerwendung der neuen Maske M' als ein Al- 
pha-Faktor, urn das neue Bild zu bestimmen. 

4. Verfahren zum Translatieren von antialiasierten 
Kanten, ausgedruckt durch eine Objekt-Maske, un- 
ter Verwendung von Hochauflosungskanteninfor- 
mationen, abgeleitet von Bilddarstellungen mit 
niedriger Auflbsung, 

wobei die Kanten Pixel umfassen, und das Verfah- 
ren umfasst: 

1) Vorsehen einer Objekt-Maske, die Pixel um- 
fasst, die Werte in kontinuierlichem Ton haben, 
einsetzend eine Anzahl von Grau-Pegeln G 
grofier als 2; 

2) Vorsehen einer Version mit hoher Auflosung 
der Pixel, die von Interesse sind, in der Objekt- 
Maske, umfassend eine Mehrzahl von Unter- 
Pixeln; 

gekennzeichnet durch: 

3) Zuordnen eines Binar-Masken-Werts m zu 
jedem Unter-Pixel als eine Funktion einer Po- 
sition davon innerhalb des Pixels, das von In- 
teresse ist, und der Werte von irgendwelchen 
Pixeln, die benachbart zu dem Pixel, das von 
Interesse ist, sind; 

4) Variieren der Unter-Pixel-Masken- Werte, urn 
die Kantenposition innerhalb eines Pixels, das 
von Interesse ist, zu translatieren; 

5) Kombinieren der variierten Hoch-Auflo- 
sungs-Versionen von Pixeln in dem Umfang 
der erwunschten Translation, urn ein Pixel, das 
von Interesse ist, durch Mitteln der Unter-Pi- 
xel-Masken-Werte in dem Pixel, das von Inter- 
esse ist, urn einen End-Ausgaben-Masken- 
Wert fur das Pixel, das von Interesse ist, zu be- 
stimmen. 

5. Verfahren nach Anspruch 4, wobei der Schritt 2 ein 
Aufnehmen einer Mehrzahl von benachbarten Pi- 
xeln fur jedes der Pixel, die von Interesse sind, urn* 
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fasst. 

6. Verfahren nach einem der vorhergehenden Anspru- 
che, wobei die Mehrzahl von Unter-Pixeln fur jedes 
Pixel eine vorbestimmte Zahl N ist. 

7. Verfahren nach Anspruch 1 bis 3, wobei Schritt 2, 
Oder nach den Anspriichen 4 bis 6, 

wobei Schritt 3 umfasst: 

1) Bestimmen von dem Masken-Wert fur das 
Pixel, das von Interesse ist, eine Zahl p von Un- 
ter-Pixeln, die transparent sein sollten; 

2) Bestimmen eines Teil-Permeabilitats-Werts 
fur jedes Unter-Pixel als eine Funktion des 
Masken-Werts des Pixels, das von Interesse 
ist, des Masken-Werts mindestens eines Nach- 
bar-Pixels in der Vielzahl davon und der relati- 

. ven Position des Unter-Pixels in dem Pixel, das 
von Interesse ist, von dem mindestens einen 
Nachbarn; 

3) Sortieren der bestimmten Teil-Permeabili- 
tats-Werte nach Grolien und Identifizieren sol- 
cher Unter-Pixel, die die p groliten Grofcen ha- 
ben, als permeabel. 

8. Verfahren nach einem der vorhergehenden Anspru- 
che, wobei die Vielzahl von Nachbarn 8 angrenzen- 
de Pixel umfasst, und die bestimmte Anzah! von 
Unter-Pixeln ungefahr 25 ist. 

9. Verfahren nach einem der vorhergehenden Anspru- 
che, wobei p bestimmt ist durch die Funktion: 

p=SM/N 

wobei M der Masken-Wert des Pixels, das von In- 
teresse ist, ist, S die Zahl von Unter-Pixeln ist und 
N der Masken-Wert eines vollstandig permeablen 
Pixels ist. 



Revendications 

1. Precede destine a effectuer des changements de 
la position du bord d'un objet dans des images a ton 
continu combinant une image existante A, un mas- 
que de gris M et une valeur de nuance C pour un 
objet qui doit etre ajoute a I'image A, comprenant 
les etapes consistant a : 

1) Prevoir un masque de gris M comprenant 
des pixels possedant des valeurs de ton conti- 
nu utilisant un nombre de niveaux de gris G su- 
perieur a 2 ; 

caracterise par : 

2) dilater le masque de gris M en une image en 



mode point m definie en termes de sous- 
pixels ; 

3) translater ou deplacer m par rapport a I'ima- 
ge A d'un certain nombre de sous-pixels pour 

5 produire un masque de sous-pixels translate 

m' ; 

4) trouver les pixels dans A recouverts par m' ; 

5) dilater les pixels trouves dans A en une ima- 
ge en mode point des sous-pixels B ; 

*o 6) remplacer tous les sous-pixels parmi les 

sous-pixels dilates correspondant a I'encre 
dans m' par la valeur de nuance C ; et 
7) filtrer les pixels dans B et renvoyer les pixels 
filtres a A. 

15 

2. Procede selon la revendication 1, dans lequel I'ex- 
pansion dans Petape 5 comprend : 

a) la determination pour le pixel presentant un 
20 interet et la pluralite de pixels voisins d'une va- 
leur de nuance minimum et d'une valeur de 
nuance maximum ; 

b) la determination d'une valeur de nuance 
pour chaque sous-pixel en fonction de la valeur 

25 de nuance du pixel presentant un interet, de la 

valeur de nuance d'un voisin au moins et de la 
position relative du sous-pixel dans le pixel pre- 
sentant un interet et d'un voisin au moins ; 

c) le triage des valeurs de nuance determinees 
30 par grandeur, en attribuant la valeur de nuance 

maximum aux sous-pixels presentant les q va- 
leurs de nuance les plus grandes et en attri- 
buant la valeur de nuance minimum aux sous- 
pixels restants. 

35 

3. Procede destine a effectuer des changements dans 
la position du bord de I'objet en images a ton continu 
combinant une image existante A, un masque de 
gris M et une couleur C pour un objet qui doit etre 

40 ajoute a I'image A, comprenant les etapes consis- 
tant a : 

1 ) prevoir un masque de gris M comprenant des 
pixels possedant des valeurs de ton continu uti- 

45 lisant un nombre de niveaux de gris G superieur 

a2; 

2) dilater le masque de gris M en une image en 
mode point m definie en termes de sous- 
pixels ; 

so caracterise par : 

3) translater ou deplacer m par rapport a I'ima- 
ge A d'un certain nombre de sous-pixels pour 
obtenirune image en mode point translated m' ; 

4) mettre en moyenne les valeurs de I'image en 
55 mode point m' pour produire un nouveau mas- 
que anticrenele M' au niveau de I'emplacement 
translate ; 

5) trouver les pixels dans I'image A recouverts 
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par M' ; 

6) effectuer le melange alpha pour ces pixels 
de Timage actuelle C avec I'image existante A 
en utilisant le nouveau masque M' comme un 
facteur alpha pour determiner la nouvelle ima- 5 

ge. 

4. Precede destine a translaterdes bords anticreneles 
exprimes par un masque d'objets, en utilisant les 
informations de bord a haute resolution derivees 10 
des representations d'image a basse resolution, 

lesdits bords comprenant des pixels et le pro- 
cede comprenant : 

1) la fourniture d'un masque d'objet compre- 15 
nant des pixels possedant des valeurs a ton 
continu en utilisant un nombre de niveau de gris 

G superieura 2 ; 

2) la fourniture d'une version a haute resolution 
des pixels presentant un interet dans le mas- 20 
que d'objet, comprenant une pluralite de sous- 
pixels ; 

caracterise par : 

3) I'attribution d'une valeur de masque binaire 

m a chaque sous-pixel en fonction.de la posi- 25 
tion de celui-ci a I'interieur du pixel presentant 
un interet et des valeurs de tous les sous-pixels 
voisins du pixel presentant un interet ; 

4) la modification des valeurs de masque de 
sous-pixels pour translater la position de bord 30 
a I'interieur d'un pixel presentant un interet ; 

5) la combinaison desdites versions a haute re- 
solution modifiees des pixels dans la portee de 
la translation desiree autour d'un pixel presen- 
tant un interet en mettant en moyenne les va- 35 
leurs de masque de sous-pixel dans le pixel 
presentant un interet pour determiner une va- 
leur de masque de sortie finale pour le pixel pre- 
sentant un interet. 

40 

5. Procede selon la revendication 4, dans lequel I'eta- 
pe 2 inclut la reception d'une pluralite de pixels voi- 
sins pour chacun des pixels presentant un interet. 

6. Procede selon Tune quelconque des revendications 45 
precedentes, dans lequel la pluralite de sous-pixels 
pour chaque pixel est un nombre predetermine N. 



fonction de la valeur de masque du pixel pre- 
sentant un interet, de la valeur de masque d'au 
moins un pixel voisin parmi la pluralite de ceux- 
ci, et de la position relative du sous-pixel dans 
le pixel presentant un interet a partir du voisin 
au moins ; 

3) Le triage des valeurs de permeabilite frac- 
tionnaire determinees par grandeur et I'identi- 
fication des sous-pixels ayant les p plus impor- 
tantes grandeurs comme permeables. 

8. Procede selon Tune quelconque des revendications 
precedentes, dans lequel la pluralite de voisins 
comprend 8 pixels adjacents et le nombre predeter- 
mine de sous-pixels est d'environ 25. 

9. Procede selon I'une quelconque des revendications 
precedentes, dans lequel p est determine par la 
fonction : 

p = SM/N 

dans laquelle M est la valeur de masque du 
pixel presentant un interet, S est le nombre de sous- 
pixels et N est la valeur de masque d'un pixel com- 
pletement permeable. 



7. Procede selon les revendications 1 a 3 dans lequel 
I'etape 2, ou selon les revendications 4 a 6, dans 50 
lequel I'etape 3 comprend : 

1) la determination a partir de la valeur de mas- 
que pour le pixel presentant un interet d'un 
nombre p de sous-pixels qui doivent etre 55 
transparents ; 

2) la determination d'une valeur de permeabili- 
te fractionnaire pour chaque sous-pixel en 
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